Speech-Centric Multimodal User Interface Design in Mobile Technology
نویسندگان
چکیده
Multimodal user interface (MUI) allows users to interact with a computer system through multiple human-computer communication channels or modalities. Users have the freedom to choose one or more modalities at the same time. MUI is especially important in mobile devices due to the limited display and keyboard size. In this chapter, we provide a survey of the MUI design in mobile technology with a speech-centric view based on our research and experience in this area (e.g., MapPointS and MiPad). In the context of several carefully chosen case studies, we discuss the main issues related to the speech-centric MUI in mobile devices, current solutions, and future directions. INtrODUctION
منابع مشابه
A speech centric mobile multimodal service useful for dyslectics and aphasics
Multimodality has the potential of benefiting non-disabled as well as disabled people. We have developed a speech-centric composite multimodal interface to a map-based information service on a mobile terminal. This interface to the service has proven useful for a severe dyslectic and an aphasic. These persons did not manage to use the ordinary public information service, neither on the web (tex...
متن کاملUser Interface Design in Mobile Educational Applications
Introduction: User interfaces are a crucial factor in ensuring the success of mobile applications. Mobile Educational Applications not only provide flexibility in learning, but also allow learners to learn at any time and any place. The purpose of this article is to investigate the effective factors affecting the design of the user interface in mobile educational applications. Methods: Quantita...
متن کاملDesigning a multimodal dialogue system for mobile phones
Due to their high spreading and increasing technical capabilities mobile phones play an important role as future user interfaces for information and transaction services in non stationary situations. The small screen size, however, introduces usability problems. Therefore, a speech centric multimodal interface will be a challenging approach for building effective user interfaces for these devic...
متن کاملA Speech-Centric Perspective for Human-Computer Interface: A Case Study
Speech technology has been playing a central role in enhancing human-machine interactions, especially for small devices for which graphical user interface has obvious limitations. The speech-centric perspective for human-computer interface advanced in this paper derives from the view that speech is the only natural and expressive modality to enable people to access information from and to inter...
متن کاملMipad: a Multimodal Interaction Prototype
Dr. Who is a Microsoft’s research project aiming at creating a speech-centric multimodal interaction framework, which serves as the foundation for the .NET natural user interface. MiPad is the application prototype that demonstrates compelling user advantages for wireless Personal Digital Assistant (PDA) devices, MiPad fully integrates continuous speech recognition (CSR) and spoken la nguage un...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2015